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(54) Perspective correction of texture In graphics by adaptive approximation 



(57) The present invention provides a computer 
graphics system with a texel value generator capably of 
generating texel values using a minimal amount of com- 
putationally intensive divisions while maintaining a 
selectable texelaccuracy criteria along a scan GheTThis 
is accomplished by adaptively selecting divisional points 
which delineate the scan line segments along each scan 
line such that the divisional points are as widely spaced 
as possible without exceeding the selected texel accu- 
racy criteria. Having selected the texel accuracy criteria, 
such as a texel error bound optimally spaced, divisional 
points along the scan lines are selected as a function of 
the selected accuracy criteria. In general, since texture 



gradients are not evenly distributed over the surface of a 
given object and texture variations are present between 
different objects of the image, it is advantageous to adap- 
tively select division points one at a time, skipping as 
many pixelsin between divisional points as trie local tex- 
ture gradient will allow. Accurate texel values are com- 
puted at these divisional points and also at the end points 
of the scan line. Approximate texel values are then com- 
puted for the pixels located between adjacent pair of divi- 
sional points along the scan line using a suitable scheme 
such as linear interpolation. 
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Description 

The present invention relates to the field of computer graphics. 

More particularly, the present invention relates to the field of texture mapping by approximation. 

The application is related to U.S. patent application serial number 08/041 ,073, filed April 1 , 1 994 entitled "A Method 
and Apparatus for an Adaptive Textural Mapping Controller", by Yakov Kamen and Uma Sabada, and assigned to Sun 
Microsystems Inc.. incorporated by reference herein to supplement the background discussion. 

The above mentioned pending application includes a general background discussion on computer graphics and 
texture mapping. As such, this background section will focus on conventional texture mapping with perspective correction, 
methods for implementing the same, and their disadvantages. 

Most conventional computer graphics systems include a display device for displaying a two dimensional image 
represented as a bit mapped array of evenly spaced pixels. Each pixel has a pixel value and is uniquely identified by an 
X-axis and a Y-axis coordinate value pair. This Cartesian X-Y coordinate representation is compatible with the majority 
of graphics display devices whose images are composed of a plurality of scan lines along the X-axis, e.g., cathode ray 
tubes (CRTs) and active/passive liquid crystal displays (LCDs). 

Conventionally, texture is defined as a modulation of color, intensity, surface normal, transparency or other surface 
property applied to a surface of a graphics object in such a way that the pattern appears attached to the surface as the 
viewpoint and perspective varies. In order to realistically display three dimensional objects in a high quality two dimen- 
sional image on the display device, a perspective^ correct texture mapping value, called a texel value, is generated for 
each pixel to modify the pixel values of the image. 

Mathematical models have been employed to provide excellent image quality but they tend to be computationally 
intensive and very demanding of the processor on the computer graphics system. Typically, the generation of texel values 
include two divisional computations or their equivalent for each pixel of the image for computing the perspective correc- 
tion. As is well known in the computer arts, divisional computations typically take a fairly large number of clock cycles, 
even when the processor is equipped with hardware dedicated to performing divisional computations. With powerful 
processors, such as a SPARC based processor, computing two divisions per pixel in real-time is possible but the resulting 
texture computations will limit the processor's ability to simultaneously support other processes. In the less powerful 
processors, such as Intel's 80486 SX microprocessor, real-time texture value computations requiring the two divisions 
per pixel can overwhelm the processor. Hence it is highly desirable to lower the computational requirements for gener- 
ating a high quality perspective^ corrected texture map. Typical conventional approaches reduce the total number of 
division computations by substituting linear interpolation for pixels at predetermined intervals between accurately com- 
puted division points. 

As shown in Figures 1 A and 1 B, in a first pre-deterministic interpolation method, parent polygon 100 is progressively 
subdivided in a geometrical manner into a predetermined number of smaller child polygons 110, 120, 130, 140, ... 190. 
Referring to Figure 1 C which shows one resulting child polygon 1 1 0 in greater detail, accurate texel values are computed 
for pairs of end points, e.g.. end points 1 1 1a and 1 1 1z, where a scan line 1 1 1 intersects the boundaries of child polygon 
1 10. Next, approximate texel values are computed for pixels 1 1 1 b, 1 1 1c, ... 1 1 1y located between end points 1 1 1 a. 1 1 1 z, 
by linearly interpolating along scan line 111. This process is repeated for the remaining scan lines 1 12, 1 13, ... 1 19 of 
child polygon 110, and also repeated in a similar manner for every scan line of the remaining child polygons 120, 130. 
... 190, until texel values for every pixel within parent polygon 100 have been computed. 

Referring now to Figure 2A f a second pre-deterministic interpolation method involves subdividing each scan line, 
e g., scan line 210 of a polygon 200, into scan line segments delineated by a predetermined number of divisional points 
212 213 ... 218. and end points 21 1. 219 is shown. For each scan line, e.g.. scan line 210, accurate texel values are 
computed for end points 21 1, 219 and divisional points 212, 213, ... 218. Next, as shown in Figure 2B, texel values for 
the remaining pixels, 211a, 211b, ... 211z, 212a, 212b ... 212z, .... 218a 218b, ...218z along scan line 210 are then 
computed by linear interpolation. This process is repeated for the remaining scan lines 220. 230. ... 290. until texel values 
have been computed for every pixel in polygon 200. .... 

In the above described conventional methods, linear interpolation of intermediate texel values can be accomplished 
with the following exemplary equations as applied to a polygon 2000 of Figure 2C. Polygon 2000 is a triangle specified 
by a triple (jq, y v z if w„ Ui.vg. I = 1 ,2.3, where (*-, yd are the device coordinate of the triangle vertices, z x are the 2 depth 
at the vertices, w x are the absolute value of the reciprocals of the w components of the vertices in the homogeneous clip 
coordinate system, and (Uj, v,.) are the two-dimensional texture coordinate of the vertices. U V, and Ware the respective 
linearly interpolated values of u, v, w, along the left edge of triangle 2000 between (x At y h z^w h u^) and 




(EQi) 
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(EQ iO 



w* w 0 + (x-x 0 )^ (EQiii) 

and u Q = U(;r 0 ,y 0 ) (EQ iv) 

w 0 m W{x ol y c ) (EQ v) 

* 0 = ^(Wo) (EQ vi) 

texture = texmap Qj, ^ (EQ vii) 



While the above described conventional methods do reduce the computational load on the processor by replacing 
some computationally intensive divisions with simpler linear interpolations, both conventional methods are disadvanta- 
geously inflexible, inefficient and/or produce unsatisfactory texel values. This is because pre-determining the amount of 
divisions works well only if texture variations between objects and texture gradients within objects over the entire image 
are both fairly constant In practice, different objects in different images can have different texture properties and so no 
one predetermined level of scan line division will be optimal for all objects. For example, if the predetermined scan line 
segments are too short, i.e., the divisional points too closely spaced, an excessive amount of Divisional computations 
will be required of the processor. Conversely, if the predetermined scan line segments are too large, grossly inaccurate 
approximations of texel values will result at distant pixel locations relative to the divisional points, and the overall texture 
quality of the image will be poor. 

SUMMARY O F THE INVENTION 

The present invention provides a computer graphics system with a texel value generator capably of generating texel 
values using a minimal amount of computationally intensive divisions, i.e., a minimal number of divisional points, while 
maintaining a selectable texel accuracy criteria along a scan line. This is accomplished by adaptively selecting the divi- 
sional point(s) which delineate the scan line segments) along each scan line such that the divisional points are as widely 
spaced as possible without exceeding the selected texel accuracy criteria. 

Having selected the texel accuracy criteria, such as a texel error bound, the locations of the divisional points along 
the scan lines are computed as a function of the selected accuracy criteria In general, since texture gradients are not 
evenly distrftxjted over the surface of a given object and texture variations are present between different objects of the 
image, it is advantageous to adaptively select division points one at a time, skipping as many pixels in between divisional 
points as the local texture gradient will allow. In other words, the optional number of pixels between any two adjacent 
divisional points varies in accordance with the local texture gradient 

Once the divisional points between the end points of a scan line have been selected, accurate texel values are 
computed at these divisional points and also at the end points of the scan line. Typically, two divisions or equivalent 
mathematical operations such a reciprocal and a multiply computation, are used to accurately computing each texel 
value. Next, approximate texel values are computed for the pixels located between adjacent pair of divisional points 
along the scan lina Suitable approximation schemes include interpolation methods such as linear interpolation. 

The above described process of selecting divisional points, computing accurate texel values at these divisional 
points and end points, and then approximating texel values for pixels lying in between adjacent divisional points and/or 
end points, is repeated for each scan line overlapping the given object until all the pixel texel values for displaying the 
object have been computed. 

The present invention will now be further described, by way of example, with reference to the accompanying draw- 
ings, in which:- 

Figure 1A and 1 B illustrate is a flow chart a conventional method of dividing parent polygon into a pre-determined 
plurality of child polygons 

Figure 1C shows one of the child polygons of Figure IB in greater detail 

Figure 2A and 2B illustrate a conventional method of dividing scan lines of a polygon into groups of contiguous 
pixels separated by a pre-determined number of divisional points. 

Figure 2C shows an exemplary triangle for illustrating linear interpolation of intermediate texel values. 
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Figure 3 is a block diagram illustrating a texture mapping system which includes a texel value generator of the 
present invention. 

Figures 4A and 4B are flow charts illustrating a method for adaptively sub-dividing a scan line in accordance with 
the invention. 

s Figure 5 illustrates a polygon having an optimally sub-divided scan line. 

Figure 6 is a flow chart illustrating a method for approximating texel values while satisfying a selectable texel accu- 
racy criteria 

DEFINITIONS 

10 

Pixel : an integral point located on a pre-defined coordinate system, e.g., X-Y coordinate, that has a pixel value 
associated with an image of a given object to be displayed. 

MIP (multum in parvo) map : a pyramidal parametric data structure which allows both intra-level and inter-level 
trilinear interpolation schemes, e.g., in an [u, v, d[ coordinate system, where u, v are spatial coordinates used to access 
15 points within a pyramid level, and the d coordinate is used to index and interpolate between the different levels of the 
pyramid. 

Texel value : a texture value for mapping a corresponding pixel value so as to display texture on a given object from 
a given perspective. 

Graphics image : a representation of a given object for cfisplay on a graphics display device. 
20 Polygon : a m a thematically convenient shaped area of interest on a given object 

DESCRIPTION OF THE PREFERRED EMBODIMENT 

In the following description, numerous details provide a thorough understanding of the present invention. These 
25 details include functional blocks and exemplary texel accuracy criteria to assist a developer in implementing an efficient 
adaptive texel value generator in software, hardware or a combination thereof. In addition, while the texel value generator 
of the present invention is described with reference to a specific implementation, the invention is applicable to a wide 
variety of computer graphics systems and environments. In other instances, well-known circuits, structures and program 
code are not described in detail so as not to obscure the invention unnecessarily. 
30 Figure 3 is a block diagram illustrating one embodiment of a texture mapping system 300 which includes a texel 
value generator 310 of the present invention. Texture mapping system 300 also includes a M IP-map selector 320, a 
texture lookup table 330, an illumination value generator 340, a combiner 350, a bit-mapped pixel value buffer 360, three 
digital-to-analog converters (DACs) 370a, 370b, 370c, and a display device 380. 

Texel value generator 310 is coupled to texture lookup table 330, both directly and through MlP-map selector 320. 
35 The respective output nodes of texture lookup table 330 and illumination value generator 340 are coupled to combiner 
350. The output node of combiner 350 is coupled to bit-mapped pixel value buffer 360. In turn, pixel value buffer 360 iis 
coupled to the digital input nodes of DACs 370a, 370b, 370c. The analog output nodes of DACs 370a, 370b, 370c arc 
coupled to display device 380. 

Texel value generator 310 provides u, v signals and derivative u, v signals to texture lookup table 330 and MIP 
40 selector 320, respectively. In turn, MIP selector 320 provides MlP-map select signals to texture lookup table 330. Texture 
lookup table 330 and illumination value generator 340 produce texture and illumination values, respectively, for combiner 
350. Combiner 350 then combines these texture and illumination values, together with feedback pixel values from pixel 
value buffer 360, and generates composite bit-mapped pixel values for buffer 360. Finally, pixel value buffer 360 provides 
the respective digital RGB signals, which are converted by DACs 370a, 370b, 370c, into the corresponding analog RBG 
45 signals to display device 380. 

Rgure 4A and 4B are flow charts illustrating an optimal method for adaptively subdividing a scan line, the method 
useful in association with texel value generator 31 0. In one embodiment, in order to be compatible with most conventional 
graphics display devices, the texel values are generated along parallel scan lines which are bounded by polygons, each 
of which define an area of interest on a given object Each scan line has pairs of end points where the scan line intersects 
so the boundary of a polygon. These scan lines are decomposable into rows of pixels at integral locations in an X-Y coor- 
dinate system. 

Referring to the flowchart of Rgure 4A, first the end points of a scan line are adjusted to integral pixel coordinate 
locations by a suitable method, such as trucation or rounding up/down (step 410). if the scan line is extremely short, 
i.e., the span of the scan line is empty because the two integral end points have merged, then no sub-division is required 
55 (step 420). Similarly, if the span of the scan line is too short to substantially benefit from any sub-division, no sub-division 
is performed (step 430). 

Conversely, if the span is long enough to substantially benefit from sub-division, texel value generator 3 1 0 adaptively 
sub-divides the span of the scan line into a minimum number of optimally spaced sub-divisions (step 440). 



4 
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Referring now to the flowchart of Figure 4B, step 440 is shown in greater detail. First a suitable texel accuracy criteria 
is selected (step 442). In this embodiment, the texel accuracy criteria is a texel error bound. Starting at one end of the 
scanline, texel value generator 310 computes the location of the next integral divisional point along the scan fine corre- 
sponding to the largest posstole sub-divisional spacing that satisfies the selected accuracy criteria (step 444). The com- 

s putation of additional divisional point(s) is repeated along the scan fine until the opposite end of scan line is reached 
(step 446). Appendices A and B show equations and a computer program, respectively, for computing the location of 
divisional point(s) in the preferred embodiment 

Figure 5 illustrates a polygon 500 having a scan line 510 subdivided by division points X& x 3l x* and end points xi, 
x 5 . In accordance with the preferred embodiment the error of the approximated texture values increases, reaches a 

io maximum at or approximately at an error bound value e and then decreases between adjacent division/end points. Note 
that optimizing with respect to an error bound e, may result in uneven spacing as illustrated by end/division point pairs 
x-, and X2, x 2 and X3, x 3 and x*. and x* and x 5 . In the preferred embodiment the spacing f between adjacent divisional 
points are computed using the following equation: 



15 



20 



40 



50 



tme+2 >l e \dwi < E Q viii ) 



where e = the error bound 

iv » absolute value of the reciprocals of the w components 

and**. 21^* 

XT - Xl 

where wf=w value at the left divisional point 

25 

and wrm w value at the adjacent right al visional point 

Note that along the span of a scan line, at a given step t, rfwand e are constants, and wf changes. One suitable 
value for e is"0.5;Te. ( half a pixel. By selecting e - 0.5, each pixel will map to within half a pixel of where it should go. 
30 Although magnified texel edges will show an occasional glitch of non-monotonicity, this can easily be corrected by 
decreasing the selected e value. Conversely, increasing the selected e value increases the probability of glitches since 
the error bound is increased. 

Alternatively, equation vifi can be of the form: 

35 . 

By normalizing wover the polygon, m wT can be kept in the range [0,1]. A look up table for a square root function 
can be used in place of a square root computation. Further efficiency is also possible because 

is constant over each polygon. 

45 Figure 6 is a flow chart illustrating a method for approximating the texel values along the span of the scan line after 
the divisional point(s). if any, have been select First texel value generator 310 computes accurate texel values at the 
two integral end points (step 610). Accurate texel values are also computed for the integral divisional point(s), if any, 
selected in step 444 (step 620). Finally, texel value generator 310 which includes an approximator 310a generates 
approximate texel values for the intermediate pixels located between adjacent end points and divisional points) of each 
scan line (step 630). Suitable approximation methods include interpolating techniques such as the linear interpolation 
using the equations EQ (i) - (ix) described above. 

In some embodiments, mip map levels are also computed by approximation. Since each of the subdivided line 
segments defined by adjacent divisional points is affine, the MIP map level is constant across each line segment. Typ- 
ically, M IP maps are decimated by a factor of 2 in u and v: Hence. MIP map levels can be approximated using the following 
equation: 
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While the present invention has been described in conjunction with a preferred embodiment numerous additions 
and modifications are possible without departing from the spirit of the invention. Hence, the scope of the invention should 
be determined by the following claims. 



APPENDIX A 



Introduction 
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Let a triangle be specified by the triple (xi.yvri.wi.ui.vi), 1=0,1,2, where (xi.yi) are the device coordinates of the triangle 
vertices, zi arc the Z depth si the vertices, wi are the 



(xO.yO.zO.wO.uO.vO) 




(atl.yl.zl.wl.ul.vl) 



20 



(x2.y2.z2.w2,u2.v2) 



absolute value of the reciprocals of the w components of the vertices in the homogeneous clip coordinate system, and (ui, 
vi) are the two-dimensional texture coordinates of the vertices. 



25 For 2D textures of width W and height H, we define the mapping from any texture coordinate (u, v) to a point (p, q) in the 

half-open texel space [0,W> X [0JI) to be 

r- <-l"J>** f (eq i) 

q = (y-lvj) *H 

30 This is slightly different from the XGL and OpcnOL formulation that maps u=l or v=l to W-i or H-U respectively. (EQ 

1) is preferable since ii has a simple mapping to fixed point arithmetic. For example, to perform the linear interpolation 

u - uO + nxdu (EQ 2) 



35 



AO 



and map u to texel p, we would compute 



f/0 » yO-L-Oj 
DO - du-lduj 



(EQ3) 



V - UO + nxDU (EQ*) 

p ~ UxW (EOS) 

where UO and DU are considered to be unsigned binary fractions 0 JZ (EQ 4) is computed in 32 bit arithmetic ignoring 
overflow, and (EQ 5) is computed to as many fractional bits as desired (eg-, (U*W>>32 gives nearest neighbor map- 
ping.) 

To convert from XGL or OpenGL texture coordinates to ours, it suffices to apply ascaJe factor of slightly less than one in 
u and v. 

An affile texturing results when the wi values are ignored and the (ui. vi) arc linearly interpolated over "the triangle. A per- 
spective texturing results when (ui * wi, vi * wi wi) are linearly interpolated over the triangle, and the texture coordinates 
(u, v) obtained by computing (ui wi/ wi, vi wi/wi) per pixel. In other word*, you multiply ui and wi, and interpolate that 
product. For each pixel, you divide the interpolated product by the interpolated wi. 



55 
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5 Clearly, the two arc equivalent if wi is constant over the triangle. Also clearly, the difference between the affine and per- 

spective mapping increases as the ratio min(wi) / max(wi) decreases. * 

Due to the linearity of the operation in (EQ I), for an affinely textured triangle, the (ui. vi) values as well as the du/dy dv/ 
dy. du/dx. dv/dx values over the triangle can all be mapped to the range [0.1) via the operation «-L«J » /V« c (u) 
applied once at the vertices. Specifically, it is obvious that 

Frac(uO+nxdu) a Frac (Frac (uQ)' + n x Free (</«)) (GQ «) 

This is why (EQ 3) and (EQ 4) work. 

is Adaptive Subdivision 

Perspective texturing interpolaies uw, vw. and w. instead of u and v. Thus, along the left edge of the triangle below, w c 

(uOwO, vOwO. wO) 

20 xJ. y / ^^.^ xr. y 

uwl. vwl, wl /— . — • __rsi*^uwT. vwr, wr 
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- (u2w2,v2w2,w2) 

(ulwl, vlwl. wl> 

interpolate, e.g.. uwl linearly between uO x wO and ul x wl. Across the scan line, we linearly approximate, e tr uw 
between uwl and uwr. ' 

There would be at most a minor gain in performance in doing an adaptive approximation along the triangle edges; we 
30 would save only the computation of wl and wr at the cost of the extra work in doing the approximation. However* across 

the scan line, the work to be saved is the two divides per pixel (or one reciprocal and two multiplies). 

The approximation wc wish to pursue is a piecewise-linear approximation to the perspective texturing (uw/w vw/w) 
across the scan line at y (see the figure.) We wish to subdivide the scan line into segments such that; 

• Each segment has the same maximum error 

♦ There are as few segments as possible 

As our error criteria, we choose pixel error. That is, we want a particular lexei at (u.v) to map linearly to (x'.yO where 
(x'y') is dose enough to the correct perspective location (x,y). tt is incorrect to choose lexei error if one wants to use a 
constant error bound. 

Since we are operating on a scan line only, we need consider only x as varying. We will derive the below using x and u 
only; we will discover a surprising result that obviates the need to derive the x and v relationship. 

We have the following equations: 

(EQ 7) 

which maps the pixel location x in the range [xl. xrj to a value t in the range (0, 1]; 

UL(t) - t*/ + /(«r-ii/) [EQ*) 



12/14704 
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which La the linear interpolation of u between ul and ur; 

UP 0) 



utwt •¥ t (urwf - uiwl) 
wt -+ t (wr — *W) 



which is the perspective interpolation of u between ul wl/wl and ur wr/wr; and finally 



(EQ 9) 



(EQ 10) 



which maps u in the range [0.1) to the corresponding texture map pixel horizontal coordinate. W is the width of the tex- 
ture map. If a nearest neighbor mapping is desired: then one takes the floor of M. 

The pixel error then becomes, given the horizontal coordinate m, 

<rr(m) - T~\ {UL" X {M' x (m)) ) -7"~ l (VP~ X (M' x ("») ) ) (EQ 11) 

the left term is the inverse of the affine approximation, the right term is the perspective inverse. 

Now, let's find the value of m for which the error is maximal 

We have 

T _l (0 « xl + t(xr-xl) 
u — ul 



vr- x (u) 



ur — ut 
(aiwi—uwQ 



(EQ 12) 



M~ l (m) - £ 



Expanding out cxr<m) using the above and simplifying, we have 



(Wut-m) (Wur-m) (wr-wQ (xr-xQ 



(EQ13) 



Examining the shape of the error curve with Mathemarica. we see that it is a convex curve with a well -defined maxima or 
minima. A sample curve is in the following figure. The next step is differentiating with respect torn: 
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25 



In the denominator, W ia always nonzero. Wc assume, for the moment, that ul**r. Thai assumption also ensures (hat the 
term 

is nonzero, as well. To sec that, rewrite Wul as ml and Wur as mr. Then, for it to be zero, we must have 

wlmJ -wrmr » m (>W - wr) (EQ Ifl) 

y 5 Since m is in the range (mi, mrj, we can write m as ml + t(mr-ml); substituting in the above and simplifying, we get 

wr (ml - rrw) « f(^-wr) (w-m/) (EQ 17) 

Since ml *mr , that reduces to 

20 i - wr (EG 13) 

Now we have wl. wr > 0. therefore t > 1, which contradicts m being in the range [ml, mr]. Therefore, (EQ 15) is nonzero. 
Thus, we can find the maximum by equating the numerator of (EQ 14) to zero, and solving for m. 
This gives us the two solutions 

" { — ja-jz k j?l+jz> — 1 (EQ 1 } 

S Lnce wl can equal wr, the first solution is not the one we seek. Now, we substitute the second value back into srr(m) from 
(EQ 13) to get the remarkable value for the error 

An alternative formula don of the above is to let a s mui ( wt * wr ) ^ rewrite it as ' | 

<rr{m^J - (xr-xof^ (EO Zl) 

The amazing thing about the above is that it is independent of u and the texture map width W! To paraphrase, the pixel 
error in using affine texturing insxead of perspective texturing depends only on the width of the span and the ratio of the w 
values at the span ends. 

Going back to our original assumption that ut*ur t we can now see that if they are equal, no subdivision is needed (the 
45 whole scan line is the same texel). In that case, for simplicity wc choose to subdivide anyway rather than check for thai 

exception. 

Now lei's calculate the pixel value in the range (xJ, xxj for which the maximum error occurs. There are two ways to map 

"War tO X, via 

SO 



35 



9 



EP 0 718 797 A2 



T' x (UL~ l (A/- 1 («) ) ) (EQ 22) 



7-' (i/P- 1 {.*/-» («))) (EQ23) 

The coiiect inverse to use is (EQ 23), as wc want the correct x, not ±c appro ximaic x. This gives the point of maximum 
error as 

Now, we are ready id solve the problem as posed originally. Let 



zr « + f 

rfw - 

xr-xl 

>^r S3 wl + id™ 



<EQ 25) 



for t=0, 1 xr-xl. Then we can rewrite (EQ 20) as 

(EQ 26) gives us the maximum error of an affine approximation if we subdivide at xt. Now let us solve for t given a fixed 
error e. We have the two solutions 

< = ^f£ * (EQ 27) 

Since i must increase as c increases, we pick the + branch. If dw < 0, we choose the negative sign f« e to maintain a real 
radical: wc get the same effect by choosing Abs(dw] instead. Therefore, the point to subdivide a span given a desired 
maximum error e > 0 is 



Note that as we step along the span, t at a time, dw and e are constant, and only wl changes. 

A good value to use for e is 0 J. eg., half a pixeL That means that each texts! will map to within Haifa pixel of where it 
should so Magnified tcxel edges will show an occasional glitch of nonmonotonicity. Increasing the error increases Uie 
glitch probability and also increases the maximum magnitude. Sec the figures for examples. Since we actually are subdi- 
viding across a scan line, we want to subdivide at pixel boundaries. We simply adjust t to the next pixeL 
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Determining triangle afflneness 



How does one determine if a triangle is sufficiently small (or the w values are close enough) thai the entire triangle can be 
textured affineiy? 

We use (EQ 21). Since we did not. in fact, maJcc any assumptions about the direction of the span, we can conclude that a 
1Q triangle is affine if the error istrr {m mmMar J S 0 J for all segments within the triangie. with the (xr - xl) term replaced by 

the length of the segment. 

We can calculate the maximum possible length by using the max norm, or the max of the width or height of the triangle 
bounding box. To calculate the maximum value of the w expression, let a = mtn , ' ' ~~} and expand fEO 20 to 

m-iz ( wmO, wi, w2) *^ ^ ^ ' 

€rr trtm. , t< s max < w idtK * h ci * > 7— ^§ (EQ 2fl) 

We can lookup the square root expression in a table indexed between (0.1 J. The cost of determining triangle afSneness is 
the cost of calculating the bounding box, the minimum ratio, a table lookup and a multiply. 

We have noc investigated more accurate estimations of afnneness. One possible approach is to observe that the maximum 
error must occur along a segment whose endpoints lie on the triangle boundary. 
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Mlp map level calculation 



Since each of the subdivided segments is affine. the scale is constant across that segment. Thus, the mipmap level is also 
constant across the segment. 

A quick way x> esiimak: uSe scale is to assume that the texture is uniformly scaled and-just compute Lhc euclidean norm 
across the scan line 



Since the mipmaps typically used are decimated by a factor of 2 in u and v. the corresponding mipmap level to choose is 
log 7 {scale) , or / 

! 

Note that the Uogb function is a quick approximation to log 3 , as one will be using an integral level anyway. 



SO 



55 



11 



EP 0 718 797 A2 




12 



EP 0 718 797 A2 




E 2 - Tha only cift«fenc* b*t>v(wn this and FK3URS 1. !a :hat th« -rror cutoff a now 4 0 Tior« 

a/« fow*r aubdrvcsions p«r scan lin*. rt texiuro -nao w&f© an imaqa ci a faca f*f«wor 
high-frequency spatial cornoonants). :h«n th« arooximatcn woub stHI b* nearly 
indistinguishable (mm the exad texturing. 
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/• Exemplary rout in* to .-Mbdivide a span to approximate a P*rap -tlv« transform •/ 

/• pixel error threshold. An exp*r Mentally-determined good value •/ 
#defin« ER* 0.5 

*dofin* MAXXNOTS (100) 

3t:ucc subdlv ( 
/• 

uwL, vwl, wl; o*w, v*w, w at left of span. Kota that It is u»w, v»w, 

and v that are linearly interpolated down Che edg«s. 
duw, dvw, dw: d(uw)/dx, d(vwl/dx, dw/dx, which are constant ov«r 
th« triangle. 

xl, xc: the span In fract pixels, we subdivide this span at 
Integral pixel coords. 

*/ 

float uwli 
float vwi; 
float wl/ 
float duw; 
float dw; 
float dw; 
float xl; . 
float xr; 

Int n; /• # of values here */ 

/• If n « 0 f empty span, 
for n >- 2, last span extends from 
25 x to x # inclusive. Initial spans 

«xtend from x to x-1 */ 

struct { 

Int x; /♦ x of start of sub span •/ 
float ur/^u at start of subspan *J 
float v/7* v at start of subspan */ 
) knots {KAJOCHOT3] / 

30 )? 

*d«flne APPEND <uu,w,xx) do { \ 

assert (s->n>-G 44 s->n<MAXXNOTS) ; \ 
3->knots(3->nl.u - uu; \ 
3 ->knota(j->n).v - w; \ 
»->knots (s->n) .x - xx; \ 
35 3 ->n++; ) while (0) 

static void 

aubdiv (struct subdlv *s) 
I 

int ixl, ixr, cat, it; 

float ldel, duw, dvw, dw, wl, wl, wl, winv, b, c? 

40 

/* initialize to no subdivisions •/ 
3 ->n - 0; 

/* adjust aiidpoints to integral pixels */ 

/• ceiK) and ceil 0-1 rule for left and right polygon edges */ 
ixl - ceil (s->xl) ; 
cnt - ceil{s->xr) - ixl? 

/* empty span? *f 
if (cnt <- 0) 
return; 

ldal - s->xl - ixl; 
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35 



40 



duv - j->duv; 
dvv - s->dw/ 
dw - j->dw/ 

uwl - 3 ->uwl * duw*ldel/ 
wi - s-:> wl # dw-ldel; 
vj. - 3 ->wl + dw •Ldel; 

/• ahort span? •/ 
If (cnt 1) f 
winv - 

APPEND (uwfvinv, wl'vinv, ixi); 
AP?END<0.0, 0.0, txll; 
return; 



Ixr - ixl+ent-1/ 

/• optimally subdivide the span •/ 

/• Initialise subdivision calculation •/ 

if {dw < 0.0) dw - -dw/ 

b - 2.0'sqrt (ERR) /sqrc (dw) / 



for I;.-) ( 

winv - 1.0/wl; 

/• output left parr of subdivision «/ 
25 APPEN0 (uwl'winv, wl'winv, lxl); 

/• solve for the t value that would give an error - ERR 
C - b*aqrC{wl) ERA/ 

/* plcx next largest integral t •/ 
It - ceil (t) / 
30 assort (it > 0) ; 

t - lc/ 

if (It >- (ixr - ixi) ) 

/• no further subdivision occur 3 •/ 
break; 

else ( 

/* subdivide at t •/ f 
uwl t*duv; 
wl t*dvw; 
wl t*dv; 

. Ixi It/ 



assert (wl > 0.0); 



/* output right end of 1*3 c span •/ 

t - Ixr - lxl; 

vinv - 1.0/ (wl ♦ dw*t) / 

APPEND ((uwl * duw*t)*winv, (vwl «• dw»c) »vtnv f ixr) ; 
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Claims 



1. In a computer graphics system for generating and displaying images of objects on a display device, the images 
including pixels having pixel values, the graphics system including elements for modifying the images displayed on 
the display device, a method for efficiently computing texe! values so as to display texture on a given object from a 
given perspective, said method comprising the steps of: 

adaptive! y selecting a plurality of divisional points between a pair of end points along a scan line; and 
approximating a plurality of intermediate texel values for a corresponding plurality of pixels located between 
adjacent divisional points of said scan line. 

2. The method of claim 1 wherein said approximating step includes an interpolating step. 

3. The method of claim 2 wherein said interpolating step is a linear interpolating step. 

4. The method of claim 1 wherein said adaptive selection step comprises the steps of: 

selecting a texel accuracy criteria; and 

computing the locations of said divisional points located along said scan line as a function of said selected 
texel accuracy criteria. 

5. The method of claim 4 wherein said texel accuracy criteria is a texel error bound. 

6. The method of claim 5 wherein said texel error bound is a constant e, and a step f between adjacent divisional points 
is computed using an equation: 



7. The method of claim 1 further comprising the steps of: . . . 

approximating a second plurality of intermediate texel values for a second corresponding plurality of pixels 
located between one of said end points and an adjacent divisional point of said scan line. 

8. The method of claim 7 wherein said approximating step includes an interpolating step. 

9. The method of claim 8 wherein said interpolating step is a linear interpolating step. 

10. The method of claim 1 further comprising the step of: 

accurately computing a corresponding plurality of texel values at said divisional points and said end points 
of said scan lina 

1 1 . The method of claim 1 further comprising the step of using said intermediate texel values to modify said pixel values 



12. The method of claim 1 1 wherein said modifications of said pixel values includes a step of computing MIP map level 
values for said intermediate texe! values using an equation: 



13. A method of providing a texel generator for effiderrtly computing texel values so as to display texture on a given 
object from a given perspective, said method comprising the steps of: 

providing a calculator for adaptivety selecting a plurality of divisional points along a scan line; and 
providing an approximator for approximating a plurality of intermediate texel values for a corresponding plu- 
rality of pixels located between adjacent divisional points of said scan line. 

14. The method of claim 1 3 wherein said approximator includes an interpolator. 

15. The method of claim 14 wherein said interpolator is a linear interpolator. 




of said pixels. 
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16. The method of claim 13 wherein said calculator includes an element for performing the steps of: 

selecting a texel accuracy criteria; and 

computing the locations of said divisional points located along said scan line as a function of said selected 
texel accuracy criteria. 

17. The method of claim 16 wherein said texel accuracy criteria is a texel error bound. 

18. The method of claim 17 wherein said texel error bound is a constant e, and a step / between adjacent divisional 
points is computed using an equation: 



1 9. The method of claim 13 wherein said approximator also approximates a second plurality of intermediate texel values 
for a second corresponding plurality of pixels located between an end point and an adjacent divisional point of said 



20. The method of claim 13 wherein said calculator includes an element for accurately computing a plurality of texel 
values at said divisional points said end points of said scan line. 

21. Trie method of claim 13 further comprising the step of providing a combiner for using said intermediate texel values 
to modify said pixel values of said pixels. 

22. The method of daim 21 wherein said modification of said pixel values includes a step of computing MIP map level 
values for said intermediate texel values using an equation: 



23. An adaptive texel value generator useful in association with a computer graphics system for generating, modifying 
and displaying an image of objects on a display device, the image including pixels having pixel values, said texel 
value generator comprising: 

a calculator for adaptively computing the locations of a plurality of divisional points along a scan line as a 
function of a selected texel accuracy criteria; and 

an approximator coupled to said calculator, for computing a plurality of intermediate texel values for a corre- 
sponding plurality of pixels located between adjacent divisional points of said scan line. 

24. The generator of claim 23 further comprising a memory element coupled to said calculator, for storing said selected 
texel accuracy criteria. 

25. The generator of claim 24 wherein said stored texel accuracy criteria is a texel error bound. 

26. The generator of claim 25 wherein said texel error bound is a constant e, and a step f between adjacent divisional 
points is computed using an equation: 



27. The generator of claim 23 wherein said approximator includes an interpolator for interpolaring between texel values 
of said adjacent divisional points. 

28. The generator of claim 25 wherein said interpolator is a linear interpolator. 

29. The generator of claim 23 wherein said calculator includes a divider for accurately computing texel values for said 
divisional points. 

30. The generator of claim 23 wherein said pixel values are modified by computing MIP map levels of said intermediate 
texel values using an equation: 




scan line. 
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31. A texture mapping system useful in association with a computer graphics system for generating, modifying and 
displaying an image of objects on a display device, the image including pixels having pixel values, said graphics 
system comprising: 

a calculator for adaptively computing the locations of a plurality of divisional points along a scan line as a 
function of a selected texel accuracy criteria; 

an approximator coupled to said calculator, for computing a plurality of intermediate texel values for a corre- 
sponding plurality of pixels located between adjacent divisional points of said scan line; and 

a combiner coupled to said approximator for modifying said pixel values with said intermediate texel values. 

32. The mapping system of claim 31 further comprising a memory element coupled to said calculator, for storing said 
selected texel accuracy criteria. 

33. The mapping system of claim 32 wherein said stored texel accuracy criteria is a texel error bound. 

34. The mapping system of claim 33 wherein said texel error bound is a constant e, and a step r between adjacent 
divisional points is computed using an equation: 

35. The mapping system of daim 31 wherein said approximator includes an interpolator for interpolating between texel 
25 values of said adjacent divisional points. 

36. The mapping system of claim 35 wherein said interpolator is a linear interpolator. 

37. The mapping system of claim 31 wherein said calculator includes a divider for accurately computing texel values 
30 for said divisional points. 

38. The mapping system of claim 31 wherein said pixel values are modified by computing MIP map levels of said inter- 
mediate texel values using an equation: 
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Select a texel accuracy criteria 
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Compute the next Integra! divisional point 
along the scan line corresponding to the 
largest possible subdivision that satisfies the 
selected accuracy criteria. ___ 
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Compute accurate texel value(s) at the end 
point(s) 
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Compute accurate texel value(s) at the integral 
divisional point(s) of the scan line 
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Approximate the texel values for pixels located 
between adjacent end points and divisional 
point(s) 
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(54) Perspective correction of texture in graphics by adaptive approximation 



(57) The present invention provides a computer 
graphics system with a texel value generator capably of 
generating texel values using a minimal amount of com- 
putationally intensive divisions while maintaining a 
selectable texel accuracy criteria along a scan line. This 
is accomplished by adaptively selecting divisional points 
which delineate the scan line segments along each 
scan line such that the divisional points are as widely 
spaced as possible without exceeding the selected texel 
accuracy criteria. Having selected the texel accuracy 
criteria, such as a texel error bound optimally spaced, 
divisional points along the scan lines are selected as a 
function of the selected accuracy criteria. In general, 



since texture gradients are not evenly distributed over 
the surface of a given object and texture variations are 
present between different objects of the image, it is 
advantageous to adaptively select division points one at 
a time, skipping as many pixels in between divisional 
points as the local texture gradient will allow. Accurate 
texel values are computed at these divisional points and 
also at the end points of the scan line. Approximate texel 
values are then computed for the pixels located 
between adjacent pair of divisional points along the 
scan line using a suitable scheme such as linear inter- 
polation. 
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